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Abstract 

A Mean-Field theory is presented and applied to a Cellular Automata 
model of distributed packet-switched networks. It is proved that, under 
a certain set of assumptions, the critical input traffic is inversely pro- 
portional to the free packet delay of the model. The applicability of 
Mean-Field theory in queue length estimation is also investigated. Re- 
sults of theoretical derivations are compared with simulation samples to 
demonstrate the availability of the Mean-Field approach. 

1 Introduction 

Modelling computer networks is important for understanding the network be- 
haviors, especially those related to the critical phenomena. Models must assign 
an assumption to network topology. Some of them make the assumption based 
on graph theory while some others based on regular lattices |21 0] 
What kind of models is chosen depends upon the application background. 

This paper focuses on architectures of distributed packet-switched networks. 
Some overlays, mobile ad-hoc networks and metropolitan area networks fall into 
the category of "distributed" , without any central or hierarchical control and 
without differentiation among transit and end-user sites. On account of these 
characteristics, the model presented in this paper is extended from Fuks' work 
PI- Actually, the same topology was studied even in the pre-Internet history, 
within the reports of RAND on distributed networks authored by Paul Baran 
and others [HIIZI- However, only survivability of the lattices was studied there. 
We step forward this effort into dynamic behavior of packet-switched Cellular 
Automata over the lattices. 

On the other hand, previous works on Cellular Automata for data networks 
have discovered in simulations that critical traffic behavior is related to free 
packet delay in the networks |3] . By the help of Mean-Field Theory technique, 
we step forward this discovery to an approximated analytical theorem for the ex- 
tended model, where the critical traffic is inversely proportional to the free delay 
of the network, provided the assumptions of Mean-Field Theory are available. 
The most basic idea in the approximation relies on simplifying the system with 
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an identical open Jackson network. However, the application of the Mean-Field 
Theory could not be exaggerated. In estimating queue length of the model, the 
Mean-Field approach is not accurate. 

The rest parts of the paper are organized as such: section 2 describes the 
model and its parameters. Section 3 applies Mean-Field Theory to the model, 
with a certain set of approximations. Some simulation results are shown, in or- 
der to demonstrate that the Mean-Field Theory presented here are available for 
cases with any dimensionality and any neighborhood. Section 4 briefly discusses 
queue length estimated by the Mean-Field Theory, with comparison to simula- 
tion data. Finally, we summarize the works with emphasizing its significance to 
analysis and design of distributed network architectures. 

2 Model Definitions 

Cellular Automaton is a mathematical model for physical systems containing 
large amount of simple, identical and locally interacting units Any Cellu- 
lar Automata could be defined with a 4-tuple of lattice space, neighborhood, 
state set, and rule of state-transition The Cellular Automata models for 
distributed packet-switched networks (briefly "the model" or "our model" , later 
through the paper) are also defined as such. 

2.1 Lattice 

The model are defined on d-dimensional Euclidean lattice space. Originally the 
lattice is boundless and extended to infinity. For digital simulation, however, 
the lattice is often truncated in a certain d-dimensional hypercube, say L as its 
width. Because a distributed network has no geometrical center, the truncated 
lattice should be thought as periodical, i.e. the coordinate values with same 
remainder modulo L are identical. Therefore the lattice of the model is denoted 
with 

^z-^n [0, Lf (1) 
And the bases of the lattice space are denoted with e;, i = 1, 2, •, d. 

2.2 Neighborhood and Metric 

A neighborhood is a mapping from the lattice to its power set: 

A : jC^^PiC^) (2) 

For the purpose of routing packets among the sites in the model, metrics are de- 
fined with the neighborhood as well. For example, von Neumann neighborhood 
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and the periodic Taxicab metric ^ are defined by: 



A{x.) = + e^,x - Bi}, Vx e £d 



1=1 

d 



(3) 



(4) 



While Moore neighborhood and the periodic Moore metric is defined as 
follows: 



^(x) = U U x + 5]y,e, \{x} (5) 

\yi = -l,0,l ya = -lM,l [ i=l J / 



D(x,y) = max<j-^ 



I I ^ 



(6) 



Definitions in both ^ and JHl conforms to the lattice periodicity. The two 
metrics are identical in 1-dimensional cases. 



2.3 State and Transition 

The state of a site is a first-in-first-out queue of packets, each of which contains 
at least the information about its destination. Each site x's queue length at time 
k, denoted as q(x,k), is modified by both packet input and packet forwarding 
processes. 

At each discrete moment of time k, packet enters the network from outside 
any site independently with an identical probability A. The probability of more 
than one input packets is o(A). Thus, one can think there is a discrete-time 
Poisson source at each site. Destination of a newly entering packet is randomly 
selected among all possible sites with the same probability. A new packet is 
queued at the site where it enters the network. 

At each moment, a site serves the first packet in its queue, forwarding it 
to one of its neighbors properly selected with the routing criteria. The service 
time is a constant of unity. Two criteria are applied to route selection. First, 
the next-hop should be selected from the neighbors, nearest to the destination 
in the term of given metric. The nearest neighbor set of a site x to destination 
z is 

S(z; x) - {y e A(x) : D{z, y) min} (7) 

Second, the next-hop should be selected from the neighbors with minimum 
queue length within the neighbors nearest to destination. 

C(z; X, fc) = {y G B{z; x) : q{y, k) -> min} (8) 

Finally, if the minimum-queue nearest-to-destination neighbor set C(z; x, k) 
contains more than one coordinates, then anyone is selected as the next-hop, 

^Or Manhattan metric. 
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randomly with the same probabihty. If this one is current destination z, then 
the packet is not queued anymore: it leaves the system. 

Baran's distributed network model contains various neighborhoods |6j. To 
extend them into higher dimensionality, von Neumann and Moore neighbor- 
hoods are definitely well defined while other neighborhoods might not. Fuks' 
two-dimensional von Neumann Cellular Automata model allows non-periodical 
property but it's less close to the case of distributed networks where all the 
sites are identical in topology. 



Any queueing system has a critical traffic as the upper bound of the input 
traffic, so that the system converges into a stable state instead of going far from 
stability. This critical traffic is just the service rate /i in a single queueing-service 
system, while it is different for networks. 

Ohira has shown that the critical traffic is related to the free delay of the 
network |H] and Fuks has uncovered that, in two-dimensional von Neumann 
Cellular Automata model, the sufficient and necessary condition for stability of 
the model is A < l/fg, or equivalently. 



where fo is the average delay of a free packet without being queued anywhere. 
These previous results are observed in simulations. Now we prove that the law of 
^ is an analytical result under certain assumptions and is available for whatever 
dimensionality and neighborhoods rather than only for two-dimensional von 
Neumann cases. 

3.1 Approximation to Open Jackson Network 

The model defined in the previous section has the property of open queueing 
networks, i.e. all packets enter the system from outside and finally leave at 
the destination. This inspires utilizing ever-known conclusions in open Jackson 
network. 

Open Jackson network is of Markovian queueing network, i.e. packet arrival 
is a Poisson process and the service time of each site conforms to exponential 
distribution. The Jackson theorem presents the condition of stability as well as 
the queue length distribution in stable state |10[ [TT] . In the Jackson theorem, a 
parameter o'(x), called as "site traffic", is defined as the traffic observed at site 
X in the system and we have the traffic equilibrium equations 



3 Mean-Field Theory 



A, 



1 



(9) 
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(10) 
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where Tyx is the forwarding probability from site y to x and 
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Figure 1: Queue length field of a sample with d — 2, L — AO, \ — 0.08, k — 1000, 
von Neumann neighborhood, and periodic taxicab metric. Queue lengths are so 
close to each other among all the sites that assuming they have an identical a 
is reasonable. 

where ry oo represents the probability of leaving. 

Our model, however, contains sites over a lattice space, each of which is a 
discrete-time M/D/1 queueing system. Unfortunately, to the best knowledge of 
the authors, there are hardly few approaches of queueing networks consisting of 
M/D/1 systems. Then the constant service time is replaced by a exponential 
distribution with the mean value oi 1/fi = 1 . Furthermore, we ignore the 
details in route selection and approximate it with a simple, time-invariant, and 
destination- free probability, Tyx, 

Thus, the model is approximated with a continuous-time open Jackson net- 
work over the lattice space, where input traffic is an identical Poisson process 
at each site with parameter A(x) — A, and each site serves the traffic with 
parameter ii — 1. 

3.2 Mean-Field Theory for Critical Traffic 

Observing samples of queue growth processes in the model (Figure ^ , one can 
easily summarized that site traffic cr(x) seems to be a constant without difference 
referring to the coordinates. This implies that a Mean-Field Theory can be 
developed in order to get the critical traffic law of the open Jackson network 
derived from the model. 

Mean-Field Theory is an approximate technique widely used in statistical 
physics, which treats the order-parameter as spatially constant For our 

model, the Mean-Field approximation aims at an identical parameter a such 



that 

cr(x) =0-, Vx e (12) 

Three heuristic conditions, called as Mean-Field Theory assumptions, sup- 
port this approximation. 

1. Isotropy Lattice space, either infinite or periodic, is isotropic in geome- 
try. Therefore, it is reasonable to assume that, at any moment, any site 
forwards the first packet with a same probability to its neighbors. That is 



^ (l-ry,„o), Vxe^(y), Vye£'* (13) 



l^(y)l 



2. Homogeneity Further, it is assumed that the forwarding probability are 

not different among all the sites. In addition to the formula (|13|) and the 
fact |^(y)| = A, Vy G we have 

1 , 

Ty = r = - (1 - Too) 

ry,oo = Too, Vye/:'' (14) 

3. Spatial and temporal ergodicity It is assumed that the queue length 

process g(x, k) is spatially ergodic, i.e. 

E{q{-K, k)} = lim V (7(x, fc), a.s. (15) 

And furthermore, it is also temporally ergodic as long as the stable state 
(/(x) — limfc^oo li'^i k) is achieved. Later on, we denote q for either the 
ensemble, or temporal, or spatial average (in the stable state if it exists) 
of queue length processes on sites over the lattice. 

From (fT!^ and itTH) . note that A(x) are identical to A, the traffic equations 
pOfl is simplified to 



(t(x) = a -f 



^(l-^oo) 



^f7(y), VxeZ:'^ (16) 



For linear equations (|16|l are symmetric to permutations of {cr(x)}, and the 
number of equations are equal to the number of unknown variables, it is definite 
that they have a unique solution set which is satisfying (|12l) . 

Then equation H16() are reduced to a single equation referring to a: 

(J = X+{l-r^)a (17) 
and finally it is solved that 

a = A (18) 
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The value of Too has not yet determined. We'd hke to present the Mean-Field 
version of Jackson Theorem first and then derive Too by applying the well-known 
Little's Law to the mean value of packet lifetime. 

With help of the assumptions above, and the Jackson Theorem, we have 

Theorem 1 Under the assumptions of Mean- Field Thoery, the queueing net- 
work of the model converges to stable state if and only if 

,^^ = A<i (19) 

M Too 

And in the stable state, queue length on each site, q{x), conforms to an identical 
geometric distribution: 

P(g(x) = n) = (1 - Vn > 0, Vx e (20) 

And the mathematical expectation of stable queue length is: 

y^eC" (21) 

Now from the Little's Law of arbitrary queueing system, it holds in the stable 
state that 

g = Af (22) 

where f is the mathematical expectation of packet lifetime in stable state. 
When all the sites have identical queue length, lifetime of a packet is independent 
upon the path that it pass through, and is equal to the free delay tq plus the 
total time of being queued. Note that the packet must be queued tq times, and 
apply the third assumption to regard queue length of each site on a packet path 
is constant and equal to the average q, then we have 

T = fQ-\- foq (23) 

Apply (123) to we obtain an equation 

q = A(fo -I- foq) 

.„d . ^ (24) 

Recall the formulae H19|) , (|21|l in the Theorem and compare them to the 
equation 1)24(1 , we have the following corollary, which represents the law of critical 
traffic as a function of the free delay in the model^. 



■^The third assumption plays an important role here. Note that in formula I21i . q is, in 
fact, the ensemble average; while in Little's Law 1241 . q is actually a time average. Without 
the ergodicity assumption, the two formula could not be combined. 
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Corollary 2 In the Mean-Field Theory of the model, the packet's leaving prob- 
ability and the site traffic are respectively 

Too = (25) 

To 

and a = Atq (26) 

And the stability condition is equivalent to 

A < - (27) 

To 

or equally to say the critical input traffic is Xc = ^ . 

The corollary, esp. the formula H26(l . shows that the free delay of a network 
does significantly impact on the critical traffic. Actually, delay amplifyings input 
traffic to site traffic linearly; or equivalently to say, free delay in a network 
decrease the service capability of the sites. 

It is emphasized that, in the Mean-Field Theory demonstrated above, there 
is not any requirement to lattice dimensionality, nor its neighborhood type. The 
analytical result of Theorem^and its Corollary is universally available, provided 
the Mean-Field Theory assumptions are conforming to physical properties of the 
model. 



3.3 Simulation Samples 

As the upper bound of input traffic for existence of stable state, the critical 
behavior in an instance of the model may be demonstrated by its queue length 
processes or the total number of packets in the entire system, say Q{k) = 
^^g(x, fc). When the running time k is large enough, the model is thought 
of being stable if the total number Q(k) is almost unchanged as k goes larger. 
If the input traffic exceeds the critical point, then Q{k) will increase steadily to 
infinity. These phenomena are shown in Figure 13 where several sample cases 



with variety of parameters or topology characteristics are provided. Figure 2(c) 
is similar to the case that has provided. However, we have extended the 
results on critical traffic to far more general environments. 



4 Queue Length Estimation 

As any other Mean-Field approaches for statistical-physical systems, the Mean- 
Field Theory presented here can not be treated as an accurate quantitative 
result, though it almost accurately predicts the critical behavior of the model. 

4.1 Queue Length of Stable State 

Theorem ^ has given the mean value for the queue length on any site in the 
stable state, if it exists. However, the result overestimates it a little. 
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(a) d = 1, L = 100, TO = 25, Ac = 0.04 



(b) d = 1, L = 200, fo = 50, Ac = 0.02 
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(c) von Neumann lattice, d = 2, L 
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Figure 2: Simulation samples to show the critical behavior. With whatever 
dimensionality and whatever neighborhood, the model's critical traffic Ac is 
almost equal to I/tq. 



The overestimation may originated from approximating the model to an 
open Jackson network. Each site in the model is defined as an M/D/1 queueing 
system, while it becomes to M/M/1 in the Jackson network. It has been proved 
that, for Markovian routing schemes, an M/D/1 queueing network has less 
average queueing delay (or, equivalently, less queue length) in stable state than 
its M/M/1 counterpart 



4.2 Fluid approximation of the Mean-Field Theory 

On the other hand, when the value of input traffic exceeds the critical point, it 
is presented in the simulations that queue length of a site approximately grows 
as a linear function to both time and input traffic. To get this phenomenon 
explained, we combine the assumptions of the Mean-Field Theory and H25|l 
with the Fluid approximation in queueing theory |14j . 
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Figure 3: Comparison simulation to Mean-Field Theory on a one-dimensional 
sample with L = 200, k — 1000, for stable state queue length. The Mean-Field 
Fluid approximation overestimates the average queue length. 



The Fluid approximation, based on the law of large numbers, replaces discon- 
tinuous stochastic arrival and departure processes with continuous deterministic 
versions. Let q;(x, t) and (5(x, t) represents, respectively, the two continuous pro- 
cesses for packet arrival and departure happening at site x. G in our model. 
Then for the queue length approximation g(x, t), we have 

g(x, t) = a{x,t) - (5(x, t), Vx e (28) 

Arrivals are resulted by both traffic input and forwarding events, and the 
departure rate is constant /i = 1. Therefore, we have the Fluid version of (|10|l . 



q;(x, i) = 




(5(x,t) = (5(x,0)+ / rfy = 5(x,0)+t, Vx e (30) 
Jo 

With (|25|l . i.e. r-yx = (1 — l/fo)/A, another corollary is obtained. 

Corollary 3 In the Mean-Field Theory of the model, approximated with Fluid 
model, queue length at any site is growing linearly if the input traffic exceeds the 
critical value, and the growth rate is 

$ = A - — = A - Ac, Vx e £, i ^ oo (31) 
dt fa ^ ' 
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The result is compared to simulation in a way with either time fixed and 
input traffic variant or vise- versa (Figure 0J. The comparison focuses on the 
growth rate. It is reasonable that the Mean-Field Fluid approximation a little 
underestimates the rate of queue growth because Fluid approaches replace the 
stochastic processes with deterministic (D/D/1) systems. The larger the input 
traffic is, the more the rate of queue growth estimated with Mean-Field Fluid 
approach is close to the simulation. 

5 Summary 

The work is a part of research efforts on distributed network architectures. The 
property of being distributed makes a network much more reliable but a little less 
efficient than a hierarchical decentralized architecture, such as today's Internet. 
However, in some circumstances, the network is so dynamically organized (such 
as ad hoc network) that reliability is far important rather than the efficiency, 
even it is not possible to build any centralized control or any hierarchy. In some 
other circumstances such as metropolitan-area-networks, because the speed of 
physical links has greatly increased than the age of early Internet, distributed 
architecture may perform better in both reliability and efficiency. 

This paper develops a modelling method for studying distributed network 
behaviors. The introduced Cellular Automata model can be applied not only 
to analyzing but also to designing architectures, where a topology like regular 
lattices is able to be implemented. It promotes the previous works of simulation 
to an approximated analytical result, where the law of critical traffic is proved 
under a certain set of Mean-Field assumptions. Being advantageous to finite 
simulations, the analytical result refines the conditions of the law of critical 
traffic. Under these conditions, i.e. isotropy, homogeneity and ergodicity, the 
critical traffic is determined by the free delay of the network. Therefore, one 
may improve the critical behavior of a network by improving the free delay of 
its topology equivalently. 

On the other hand, the Mean-Field Theory is not able to accurately estimate 
some quantities such as average queue length in the model. Generally speaking, 
the farther the input traffic is away from the the critical point, the better the 
Mean-Field theory estimates queue length behavior, no matter what kind of 
state the model is in, stable or far from stability. In practice, quality control 
protocol may predict the queueing tendency under either definitely heavy or 
definitely light input and do actions in response. 

It is true that, once the assumptions are far from reality, the Mean-Field 
Theory will be broken. For example, when some sites in the model cease work- 
ing, packets must bypass these sites and therefore the isotropy of the model is 
destroyed. Since the critical behavior depends upon the maximum site traffic, 
it could be easily derived from H1Q(I and has been demonstrated in simulations 
that in such a case the critical input traffic is significantly less than that of 
the Mean-Field Theory, and improving free delay is still important because it 
upper-bounds the maximum-possible critical traffic. 
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(a) With fixed input traffic, the Mean-Field Fluid approaxjh estimates 
that the slope of queue length to time is A — Ac, which is near to but a 
little less than the result of simulations. 




(b) With fixed time, the Mean-Field Fluid approach estimates that the 
slope of queue length to input traffic is t, which is near to but a little 
less than the simulation results too. 



Figure 4: Comparison the simulation results to Mean-Field Fluid approxima- 
tion on one- dimensional samples with L = 200, for queue length growth far from 
stability. The Mean-Field Fluid approximation is near to but a little underesti- 
mates the queue growth rate. 
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Quantitatively analyzing non-isotropic, non-homogeneous and non-ergodic 
models, which are more close to real systems, are of the successive work after 
this paper. Like studying any new statistical-physical systems, one should get 
deep into the local details of reaction, where the fluctuations are ignored by the 
Mean-Field Theory. 
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